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An internet network force feedback system (10) which 
includes a server machine (18), a client machine (14) provided 
with the force feedback device (24), and one or more additional 
client machines (16) each of which may be provided with 
additional force feedback devices (26). The server machine 
is a computer or processor running TCP/IP server software and 
is connected to the Internet Client machine (14) runs internet 
browser software. The force feedback device (24) has sensors 
and actuators to monitor the input of the user and transmit the 
input to the client and receive response from the client and 
provide the force feedback sensations to the user. 



18 



SERVER MACHINE 



PROCESSOR RUNNING THE 
HTTP SERVER SOFTWARE. 
CONNECTED TO INTERNET 



OATA 
REQUEST 



10 



HTML FILE 
IFF RLE 



CLIENT MACHINE 



PROCESSOR RUNNING 
INTERNET BROWSER SOFT- 
WARE AND FORCE FEEDBACK 

ORtVER SOFTWARE. THIS 
PROCESSOR IS CONNECTED 
TO INTERNET AND CONNEC- 
TED TO FORCE FEEDBACK 
DEVICE 



24 



TCP/IP 
CONNEC- 
TION 



JL. 

ADOrriONAL CLIENTS j 



TRACKING AND BUTTON DATA 
FORCE FEEOBACK COMMANDS 



FORCE FEEDBACK DEVICE 



THtS OEV1CE HAS SENSORS 
AND ACTUATORS SO IT CAN 
TRACK A USERS MOTION, 
MONITOR BUTTON PRESSES 
AND PROVIDE OUTPUT FORCE 
FEEDBACK SENSATIONS. IT 
WILL SEND TRACKING AND 
SENSOR INFORMATION TO 
CLIENT. fT WILL RECEIVE 
FORCE FEEDBACK COMMANDS 
FROM CLIENT. 



26 



L^P^CK DEVICES 



Codes used to identify States party to the PCT 



AL 


Albania 


AM 


Armenia 


AT 


Austria 


AU 


Australia 


AZ 


A zcrbaijan 


BA 


Bosnia and Herzegovina 


BB 


Barbados 


BE 


Belgium 


BF 


Burkina Paso 


BC 


Bulgaria 


BJ 


Benin 


BR 


Brazil 


By 


Belarus 


CA 


Canada 


CF 


Central African Republic 


cc 


Congo 


CH 


Switzerland 


CI 


Cdte d'lvoire 


CM 


Cameroon 


CN 


China 


CU 


Cuba 


CZ 


Czech Republic 


OE 


Germany 


OK 


Denmark 


EE 


Estonia 



FOR THE PURPOSES OF INFORMATION ONLY 

«* from pages of pa mphlets publishing inlcrna , ona , ^ ^ ^ 



ES 


Spain 


Ft 


Finland 


FR 


France 


GA 


Gabon 


GB 


United Kingdom 


CE 


Georgia 


CH 


Ghana 


GN 


Guinea 


CR 


Greece 


HU 


Hungary 


IE 


Ireland 


IL 


Israel 


IS 


Iceland 


IT 


Italy 


JP 


Japan 


KE 


Kenya 


KG 


Kyrgyzstan 


KP 


Democrat* People s 




Republic of Korea 


KK 


Republic of Korea 


KZ 


Kaxaksun 


LC 


Saint Lucia 


LI 


Liechtenstein 


LK 


Sri Lanka 


LR 


Liberia 



US 
LT 
LU 
LV 
MC 
MD 
MC 
MK 

ML 



Ieso<ho 

Lithuania 

Luxembourg 

Latvia 

Monaco 

Republic of Moldova 
Madagascar 
The former Yugoslav- 
Republic of Macedonia 
Mali 



MN 


Mongolia 


MR 


Mauritania 


MW 


Malawi 


MX 


Mc* ico 


NE 


Niger 


NL 


Netherlands 


NO 


Norway 


NZ 


New Zealand 


PL 


Poland 


PT 


Portugal 


RO 


Romania 


RU 


Russian Federation 


SD 


Sudan 


SE 


Sweden 


SG 


Singapore 



SI 


Slovenia 


SK 


Slovakia 


SN 


Senegal 


SZ 


Swaziland 


TO 


Chad 


TC 


Togo 


TJ 


Tajikistan 


TM 


Turkmenistan 


TR 


Turkey 


TT 
UA 


Trinidad and Tobago 


Ukraine 


UC 


Uganda 


US 


United States of America 


UZ 


Uzbekistan 


VN 


Viet Nam 


YU 


Yugoslavia 


zw 


Zimbabwe 



WO 98/06024 



PCT/US97/12848 



10 



15 



20 



Meth od and Apparatus for Providing Force Feedback Over a Computer Network 

Background of the Invention 

This invention relates generally to human/computer interfaces, and more particularly to 
human/computer interfaces with force feedback that can operate over a network. 

The Internet has, of late, become extremely popular. The origins of the Internet date back 
several decades to a U.S. government sponsored military/research/business wide area network 
(WAN) that was designed to remain operational even in the event of the catastrophe, e.g. a major 
earthquake or a nuclear war. To accomplish this goal, robust protocols and systems were 
developed which allowed a geographically' distributed collection of computer systems to be 
connected as a WAN such that the loss of a particular computer, or group of computers, would 
not preclude the continued communication among the remaining computers. 

While the use of the Internet has been prevalent for many years now, its use has been 
limited by the arcane and difficult commands required to access the various computers on the 
network. To address.this problem, a protocol known as the "World Wide Web" or "WWW" was 
developed to provide an easier and more user-friendly interface for the Internet. With the World 
Wide Web, an entity having a domain name creates a "web page" or "page" which can provide 
information and, to a limited degree, some interactivity. 

A computer user can "browse", i.e. navigate around, the WWW by utilizing a suitable 
web browser and a network gateway (e.g., an Internet Service Provider (ISP)). For example, 
UUNET. America Online, and Global Village all provide Internet access. Currently, the most 
popular web browser, known as the Netscape® Navigator*, .s made by Netscape Corporation of 
Mountain. View. California. The web browser allows a user to specify or search for a web page 
on the WWW, and then retrieves and displays web pages on the user's computer screen. 

The Internet is based upon a transmission protocol known as "Transmission Control 
Protocol/Internet Protocol" (or "TCP/IP" for short), which sends "packets" of data between a 
host machine, e.g. a server computer on the Internet, and a client machine, e.g. a user's personal 
computer connected to the Internet. The WWW is an Internet interface protocol which is 
supported by the same TCP/IP transmission protocol. Intranets are private networks based upon 
Internet standards, and have become quite common for managing information and 
communications within an organization. Intranets, since they adhere to Internet standards, can 
often use the same web browser software and web server software as are used on the Internet. 

A web page typically includes static images and text. The images and text are specified 
in a "HyperText Mark-up Language" ("HTML") file that is sent from the web server to the client 
machine. This HTML file is parsed by the web browser in order to display the text and images 
40 on the display of the client machine. Other standardized languages or protocols are also being 
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Summary of the Invention 



The present invention is related to the transmission of information pertaining to a subset of 
the sense of touch, i.e. the transmission of forces to a user over a computer network system. The 
"force feedback" provided by the methods and apparatus of the present invention enhance the 
1 0 sensory experience of the user to provide a richer, more interesting, and more enjoyable experience. 

In a preferred method of the present invention for providing force feedback over a network, a 
connection is first established between a server machine and a client machine. The client machine 
(typically a personal computer), has a visual display {e.g.. a computer video monitor) and a force 
feedback human/computer interface device. Examples of force feedback human/computer interfaces 
15 (hereafter "force feedback devices") include force feedback joysticks, mice, trackballs, steering 
wheels, and yokes. In some embodiments of the present invention, the force feedback device 
preferably constrains movement to two degrees of freedom to match a two-dimensional configuration 
of the visual display. Three or more degrees of freedom of movement can be provided in other 
embodiments. Next, the client machine receives from the server machine both screen display 
20 information and force feedback information that is related to the screen display information. 
Preferably, the screen display information and force feedback information are encoded in an HTML 
web page file. Files and data in other protocols or languages can also be used, such as VRML. 
Next, the -iient machine displays on the monitor an image generated from the screen display 
information. The force feedback device provides a pointer event and/or a button event to the client 
with respect to the screen image, and a force feedback signal is computed based upon the detected . 
events and the force feedback information stored on the client machine. Finally, a force feedback is 
provided to a user by the force feedback device based upon the force feedback signal. 

Preferably, the force feedback device is provided with a local microprocessor which 
communicates with the client machine. The force feedback device further includes sensors and 
actuators coupled to the local microprocessor such that the force feedback signal can take the form of 
a relatively high-level force feedback command. The local microprocessor parses the force feedback 
command to control the actuators of the human/computer interface in a control loop with the sensors. 

Another preferred method of the present invention for providing force feedback over a 
network establishes a connection between a first computer and a second computer over a network. 
The first computer includes a computer input device which develops a first computer input, and a 
second computer includes a visual display and a force feedback device for providing a second 
computer input. The computer input device of the first computer may or may not also be a force 
feedback device. A screen image is displayed on the monitor of the second computer that is 
associated with stored force feedback information. A computer input is received from the first 
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more client machines on the network. When force information is downloaded from a server the 
client machine parses and interprets the force information and directly controls its interaction with the 
force feedback device on an essentially real-lime basis. In contrast, peer-to-peer or server-to-peer 
direct interaction over the network may be subject to some transmission ("latency ") delays, but 
pemuts remote interactivity with a client's force feedback device. 

These and other advantages of the present invention will become apparent upon reading the 
followmg detailed descriptions and studying the various figures of the drawings. 
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Fig- 1 is a p,ctonal representation of the Internet, a web server m.rhi 
machines: er machln c and two client 

Fig. 2 is a block-diagram of a client machine used in the , 
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Fig. 4b is a cross-sectional v,ew taken along line 4b-4b of Fig. 4a; 

Fig . 5a * ' S * PerSP " UW *« ° f • r « *— for d. ,„„, feedback device of 

Fig. 5 c u a wi ve *. „f . sccond ,„ emaM ^ fc ^ 

orotoc , Flg H 6 " " bl0Ck ° f 3 W ' de nCtWOrk (WAN ' ba -d upon Internet TCP/IP 

~ d ™-r, d Wide Web (WWW) HTML protoco.s in accordl wHH* ^ 

invention^' ? " " " 3 ^ ^ «—» w.tb the present 

-J^ 1^ " " ^ * " * — ~ « *« a web server 

Fig. 8 is a flow-diagram of the "Paxse and Interpret HTML Component" step of Fig. 7a; 
Fig. 9 is a flow-diagram of u,e "PIug-i„ Interpret .IFF File" step of Fig. 8; 

Fig. 9a is an illustration of an image displayed on a visual disolav of * ri 
generated from a downloaded HTML web page file; and ' ' * 
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Fig. 10 is a flow-diagram of a process for monitoring the "pointer state" of the force feedback 
device of the present invention. 
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Detailed Descrm.inn pjjhe Prefer red Embgdimeptg 



and a tn ^ 2 nCtWOrk SyStem '° mClUdeS 3 WidC area " etWOrk (WAN > «»* as the Internet I , 
and a number of computers or -machines- copied to the Internet ,2. For example a f Tci 
w -h, ne a second Cent machine „ and a web server mach.ne ,3. are 

As noted prev.ously, both the Internet 12 and Intranets operate using the same TCP/IP 

~^«rnr.r t machine — JZ 

^ : *e „ .at the following £ 
5 forms ot network systems that are compare with the processes and apparatus disc.osed he^n 

m ed,a ^ mdUdeS 2 ""^ ^ n0d£S 20 " imerCOnneCted b >' - —on 

an a T W tyP ' Ca,,y r ° UlerS - SWitChCS - and ° ther intel "S- ^ta transrruss.on 

apparatus wh.ch route "packets" of TCP/IP information to the des.red destination n 
.stances, the nodes 20 compnse an Interne, se.ee provider (ISP) 20a ™ 

be T , ;r s ; " backbone " of the intemet - — - web ^ : 

be.coupled d.rectly ,nto the backbone of the Interne,. 

As noted previously, the present .nvention is directed to the implementat.on of force feedback 

orcc feedback, force feedback human/computer .nterfaces (hereafter "force feedback devices") 24 
^M^^^^,^ Hand [6 respecu Jj^ 

'visua. ^ T Pr ° V COmPUtCr V ' de0 m ° n,t0rS 28 ^ 30 * - 0^ a 

s a, d s lay ). re spect,vely. which can disp.ay images I. and 12. respectively. Preferably forces 

' The machines 14-18 are considered, in the lan guage of lhe lnm „ „ e .. resoo .. 

each has „ s „ wn „„, qoc Unifom , RK0urcc ^ of ,. URL ,. 

vc„„„„, . Cent reachine. snch as Cien, toachine ,4 « ,6. sc „ ds . re , ues , for , 
s,d,„ g on. fo, exarep,,. „.h set.et ™ch,„e ,8. This is acco mpl , s J by to client nil 
nd,„ g . rcqocsl „ d . URL whlch specife , te address „ f fc ^ «^ 

™,„c ,8. Thet.ehse™.* ,8 ta scnd s . wch pa g e 3 2 wnlttn £ U. fol 
hack ,o Ok request^ Cent reachtne where ,, is "cached" in the reetnoty te RAM hard 

d,h. ot a con^ation of the two, o, the Ci.o, nt.chinc. ,„ thts ctnhodirj of I i .Ton t 
treageon the „dcodi spl av of the *« reach^ , s ^ from fc ^ ~ 
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on the client machine, and force feedback is provided to a user through the force feedback device as 
he manipulates a user manipulate object of the force feedback device. 

In another aspect of the present invention, a first client machine, such as'.client machine 14, 
and a second client machine, such as client machine 16, directly communicate force feedback 
command? m each other In standard TCP/IP protocol over the Internet 12. More particularly, client 
machine 14 can send force feedback and other information to the URL of the client machine 16. and 
the client machine 16 can send force feedback and other information in standard TCP/IP packets to 
the URL of the client machine 14. In this way, users of client machine 14 and client machine 16 can 
interact physically over the Internet 12. Of course, a server machine 18 can likewise directly 
communicate force feedback commands to a client machine 12 or 14, or all three machines can. 
interact. I 

In Fig. 2, a "personal" computer 34 architecture that can be used for client machine 14 or 
client machine 16 is shown in block diagram form. It should be noted that a variety of machine 
architectures can be used to access the Internet 12, ie. can be used as "network access computers." 
The particular architecture shown for the computer 34 is a typical personal or "FCT computer 
architecture, such as that used with EBM compatible personal computers. Web server machines can 
also have similar architectures, but are often more powerful computers known as "workstations" that 
operate under some variant of the UNIX® operating system. The Internet service providers 20a are 
likewise often UNIX-based computers or powerful personal computers running Windows NT**. The 
nodes 20 are most commonly routers built by Cisco Systems of San Jose, California. Client 
machine 14 or 16 can also take other forms, such as a television including or connected to a 
microrprocessor for Internet access. Force feedback devices used with such client machines can be 
appropriate for the particular embodiment, e.g., a TVremote control used for internet browsing on 
the abovementioned television can include force feedback functionality. 

The personal computer system 34 includes a microprocessor 36 clocked by a system clock 
CLK and which is coupled to a high speed or memory bus 38 and to a lower speed or I/O bus 40. 
The system RAM 42 and ROM 44 are typically coupled to the high speed memory bu^, while various 
peripherals, such as the video display, hard disk drive, Internet interface (often either a modem or an 
Ethernet connection), and force feedback device, are typically coupled to the slower I/O bus. The 
microprocessor executes programs stored in the various memories (RAM, ROM, hard disk, etc.) of 
the personal computer 34 to control, for example, the image display on the video display and the 
forces provided by the force feedback device. The manufacture and use of personal computers, such 
as personal computer 34, are well-known to those skilled in the art. 

In Fig. 3, a client machine 46 in accordance with the present invention includes a personal 
computer system 48 and a force feedback human/computer interface or "force feedback device" 50. 
A user 52 can receive visual information 54 and auditory information 56 from the personal computer 
48 and can manipulate the force feedback device 50 as indicated at 58a and 58b to provide input, 
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^ e.g., to command a cursor locating ^ 
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" sensor, interface 72. sensors 74 a user Z 7 " ' l0Cai Coprocessor 68 a 
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,ucrrace *° and actuator 84 
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5 ,co„ on UK image displayed upon visual display 64. I„ some embodiments. One sensor, 74 can 
communtcate directly ,„ m.croprocessor 36 wi.hou, ,he use of local microprocessor 68 The user car, 
a* . create other inpu, such as a 'button click." through the other input 78 wh.ch are cheated 
to the mtcroproccssor 36 by the local microprocessor 68 or directly, e.g.. using a game porr. 

1 0 fora . ' f H ! hC rt ,C °" °" '" e diSplay deVIM 64 » « P°*" «* "™) .ha, correlates to , desired 
0 force feedback to dre user 53. the mtcroproccssor 36 sends a force feedback commartd to the local 
rmcroprocesao, 68 over the s c„„ p„ n connect™ 88. The loctd microprocessor 68 parses this force 
feedback command and sends stgnals to the actrrato, ,„,e rf ace 80 which causes the actuator 84 , 0 
crea^ forces F on object 76. wh.ch a* expcr.enced by me user 53 as tndicated a, 60 The safety 

1 5 O f f TL K " * '"""r S " iKh "' ^ ,he ^ f '° m *■ «— ,n,erfac. 

80 ,f. for example, the use, 52 is no longer graspmg me object 76. ,„ this wav. the user 52 car, 
tntcrac, with the client machmc 46 in a yisttal. auditor and utctiie fashion ' " 

In Fig. 4a. a force feedback device 50a is provided with n user manipulate object 76a 
whtch. m thts mstanoe, i„c,udes a shaft 90 and a balhgrip ,o, joystick, 92. The force fTedb ck 
ev,ce5 aajsotncludnsapairoflioearvoicecoilncmators ("voice coils", 94 and ,6 ma, TZ) 
bojh as sensors and acutators. Aitcmatively. mc votce coils cat, be used only as actuators and 

by a first „„„ ,8 and .second link ,00. Link 98 „ coupled ,„ „„ k ,00 with a pivo, 102. and a link 

Z I ,7 h r 90 ^ * S,m8ariy ' <°" 96 iS f° u P'ed to the shaft 90 of 

*, object 76. y a first , mk , 0 6 and a second link ,08. The firs, link ,06 is coupled ro sec „„ d |ink 

5 108 by. p,vo, 1,0. and the link ,08 is coupled to the sh.fi 90of the object 76. by the pivo, 104. 

The link 98 can move in and ou, of . housing 1 12 as ,ndic„ed by rurow , ,4. and link 106 - 

10 04. and , 10 .now me objec, 76a ,o move within me constratnts of an x . y plan , OUI J, „ 
P rm„ movement ,„ a a direction orthogonal to me x-y plane. Therefore. ,he fome feedback device is 

first degree o, fmcdom m . x dtrection, ami ,„ , second degree of f,« dom ,„ fc direcl|on A ^ 
*» feedback device 50a is constdered preface m me presen, inventmn since i col ^ we,, m 
me ,w„-d,mens,onn, semen of . monitor of a clien, machine. 

4 -n,'" t Re ' "" iC ° COi ' 94 " Sh °™ " 8 CrOK SeCli0 " al Vie " <*»8 l.n= 4Mb of Fig 
4a. Thehousmg 1,2 tnCudes a cenurtl com 120 and a number of dongtJ™^ ,, 2 Z 

engages ,he com 120. Wrapped around the annatum 124 are coils ,28. The coils are elecmel 
coup,ed to acmato, andfo, sensor inKrface! . A plana ,30 is auached ,„ fc end of L 1" 
an ra coupled to the link , 8 . Tbe anma,um ,24 and ,ink 98 can move in , lima , J^ZZ 
14. Other vote, cotl configurations can also be used, such as differently shaped cores , differe „, 
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5 coil layout erc. .„ addi,i<,„. „,„„ ,vpes of acmaM „ c „ fc use<) 

co„ s ,„ r„« ^ devke 50 , such as K _ brate ^ ~ » ,„ W1 „ 

reference numerals reW ' lhe '«dtek devrce 50a. wi,„ | te 

■he lm ks of to force feedback ^ ' £ - *■ ™» «* and ,6. However. 

*. „„ ks 98 and l00 of for r;:: k tv,::::;:: r re r mbers - u °« 

connecro, 1 32 and a flexible member 1 34 Pcolleciivei ""'^ by a 

■06 and ,03. of rbe force fM d ta e k J Z 2 Z T """"" ~ - «* "* 

5 Ocxrble member 138 (alsocollectivelvcom / „ ' " """""" member 136 ■»» r 

end of the flexible member 1 34 The n,h. ng ' diy attached t0 " 

*h. m rum. , r, 8idly » ^^^V" '] T* " ' ^ 

arched ,o a p,„e of „ ^ of ^ / e *'« 7<i - ^rmrUrlv. ,b= connecro, 1 36 i s 

' member 1 38 a, ,he orhe, of irs ends Tbc rem! 7, „ ' * *" ad ' e<1 '° 

.he base 140. """""s CTd « f "«'KI« member ,38 i s rigid,, anached ,„ 

**. ^ZT^^rT .- funcwns 38 * **■ - * — ' 

n«aib,eme„bor 1 34 Z 2 „ 2^ T ^ ^ ^ " "» *~ *■ 
-d ,„ oooommodare ^T^' '.tT^-* — 

In Fig. 5b. an alternative user manipulatable object 76a take, rh, f 
can engage an aperture 144 in an alternative base 140 Th V * " S,y ' US ^ ^ 

'he flexible members 134 and .38 of the' lw ' ^ ^ ' 4 °' Can be cou P ,ed «° 

joint or fastener. f ° r exam P'<-. a ball joint or other 

In Fig. 5c, another alternative hasp idii" v ^ J ■ 
- - e„ 8 , g cd by ,be ,, p of a n^'oT J^ttT, ^ T " ^ 
manipulatable objecr 76c As before . , h, h,. .an... dien becomes the user 

■he firs, fnedbacK device »^ 5a " *° ^ ' 3 ' » d '* - 
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As noted previously, a preferred embodiment of the present invention provides a user 
man.pulatable object that has two degrees of freedom. Other user m*upulatab,e objects having one 
degree of freedom or three or more degrees of freedom are also within the scope of the present 
■nvcnuon. For example, one embodiment of the present invention provides onlv one degree of 
freedom. Other force feedback devices of the present invention include mice, joys'ticks. joypads a 
steering wheel, and yolks having two or more degrees of freedom. 

In Fig. 6. a conceptual representation of the network system 10 with force feedback mcludes 
a server machme 1 8. a client machine 14 provided with a force feedback device 24. and one or more 
addmona. client machines .6. each of which may be provided with additional force feedback devices 
26. As noted ,n this figure, the server machine is a computer or "processor- running, for examp.e. 
the TCP/IP server so.tware and is which is connected to the Internet. The client machine .4 includes 
a computer or "processor" running Interne, browser software and force feedback driver software 
The processor of the dient machine is connected to the ,nternet and to the force feedback device 24 ' 
The force feedback device 24 has sensors and actuators so that it can track movement of the user 
mampu atable object, monitor for button presses and/or other anally input devices, and prov.de 
output force feedback sensations. The force feedback device 24 sends object tracing information to 
the chent machme. and receives force feedback commands from the client machine ,4 The 
addmonal client", such as client machine .6, also includes computers or "processors" running 
Internet browser software and force feedback driver software. The processors of these additional 

25 tZZl C ° nnCCted 10 ^ Imemet ^ C ° nneCted IO f ° rCe fCedbaCk dCV,CeS aSS ° ciated ^ 

As noted in Fig. 6. a client machine .4 can send a data request to the server machme ,8 and 
m remm recetve an HTML web page Hie includtng a special file of the present invention known as' ? " 
an IFF file. As w„. be appreciated by those skilled in the an. the server must a.so have a modified 
co^gurauon file which lets it know that IFF is a vaJid MIME type. This modified file would be a 
SRM.CONF or other .CONF file. The client machine ,4 then sends force feedback commands to 
the force feedback dev.ce 24 and receives tracking and button data from the force feedback device 24 
Ghent machme ,6 can likewise send a data request to the server machine 18 and receive an HTML 
file w„h one or more IFF files. The Cent machine 16 can men interact with the force feedback 

35 daTfio I" ? feCdbaCk COmmandS l ° ** dCV,Ce 26 ^ * reCeivi "S «™*mg and button 
35 data from the force feedback device 26. 

direct^" ! H dili °K 7 0mn,UniCating Wkh * e Server ™«ine, *c client machines can communicate 
Z II T 4 ° VCr ^ IntCmCt USing " lmCmet — i0 " «-«-■ *" -ample. 

lorn I H ; V 7™"*"° Cliem 16 thr ° Ugh 3 TCP/IP C — This is 

accomp hshed maJung the URL of the diem machine ,6 known to the Cent machine .4. and vice 

vers. In th.s fashion, d.rect communication between client machines can be aecompHshed without 

.nvoivmg the server mach.ne ,8. These connections can send force feedback information and other 



30 
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5 lorceTl" \ maCh,ne " ^ eXampk - 3 « «* *« «*« 16 can send 

force feedback tnfonnatton over a TCP/IP Internet connection to the client machine ,4 which w , 

then generate a force feedback command to the force feedback device 24 When the 

£ - back at force feedback device 2, this .nformat.on can £ " £ " ^ 

chentmachme . 6 to prov.de force feedback to the user on force feedback device 26. 

10 F ' g - ?a - a fl0W dia g ram illustrates an -acquire URL" nrocess 14* „ 

tmplemnmed u s ,„ e a standard Imemo, browse, with a "plue-in" extension wtc fc c 

or force feedbach co mmM ds. A prefect ^'1^"* ^ 

oy the Applicant of the present application. - P 

■he bce, " s : 1 148 and - ,n ■ s,cp i5a a connec "°" - « - of 

o f th e H J '" C " am| "' ! ' " ' 1 » ^ desired URL is the URL 

of the destred web page residing on ,be server roanhine ,8. the „« b p, 6 e ,« lu d,„ g ,J ^ 

rerneved by server toachtne 18. In response ,„ the conTOC , 1<Jn ^ 

r; e * nd r himl nfc represe "™ s - «* - « - ^ " « - r: ' 
™:« ™ Lf,k h *— — » f ■*» « win* cora i: 

command fragments, rnstmcons, and dau, which pen™, the dtsplay of web page and orber web 

end of f,,e , e„r,. a step ,56 detects tba, fan, and the proeess ,s complered « ,58. 0 herwise £ 
HTML componem 1S parsed „ d lnttIprettd a , a 16() >n<j p[ocMs conmi . ^ m 

proeessLtt "HZ"' "* """"" "" S '»" » d *-W-*f 

P^amg) me HTM. components e,e„ before rhe enure HTML Hie i, mceived « the die,, 

™ch,„e. Aitemauve.y. „. entire HTML f„e can be rece.ved before the processing begins 

Cent m 'l FiS J"' T T P " °' mmML ^ ™ "° m ' »™=' — ** ■« » • 

~ v heptna wtd, , <HTMLaa:„ raMn d ,62 to indict dan scan of the HTML fl.e. nod , 

T„Z o, ™T '7 IT ^ ^ t)oa '' ° f ^e HTML fife is beginning. Then, an moi.arv 
comber of HTML commahcts 166 are provided ,o. for exampie. display i magK of ^ wcb p „ c „„ 

l* d : p ' of c,,em machint a < ana> — 16 » »»' — > - z o 

^STr S '" Cerh - CErmR >»^ ,68 „ given jjpdorrodae 

<EMBED ...> co mma ,d. *. -foren bddca," wi„ be ceo ttre d i„ fc d, s p, a yed browj wtndow 
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5 Other force objects bestdes button objects can also be defined and displayed, such as links text 
shders. game objects (balls, paddles, etc.), avatars, windows, icons, menu bars, drop-down menus' 
or other objects. 

In a first line 172 of the <EMBED ...> command, the force button object is defined by a 
"IFF' exterior, file, namely "FORCEBUTTON.fFF." Next, in a line 174, the size of the button is 
10 md.cated to be 100 pixels by 100 pixels. In a line 176. the initial state of the button is indicated to be 
"up" unselected), and a line 178 defines the force effect to be "vibration." A number of 
parameters 1 80 defining the character and nature of the vibration are also provided (start time length 
frequency, magnitude, etc.). In a line 182. the "trigger" for the force effect is given by the function 
MOUSEWITHIN" with its associated parameters, and by the function "BUTTONSTATE " The 
1 5 function MOUSEWITHIN determines whether the pomter .con. the position of which is controlled 
by the force feedback device, is within the specified boundaries defining a region of the force button 
Th.s reg.on can be specified by the parameters and. for example, can be defined as the exact 
delayed area of the button, or can be defined as a sub-region within the button that is smaller than 
the delayed s.ze of the button. The functton BUTTONSTATE determines whether a button or 
20 swttch of the force feedback device is in the desired state to trigger the force object event (e g a 
button event in this example). In a line 184, the tcon representing the force button is specified" as 
LOUIS.GIF, • and the text associated with the button is defined as "Hi, I'm Louis" in a line 186 
The font of the text is given as "Helvetica" in a line 188. Other force effects, triggers and parameters 
^ can a.so be associated with the force object. For example, a force (such as a vibration) can be 
o tnggered if the pointing icon is moved a predetermined velocity or within a predefined rang- -f 
veloctt.es within the force object. Or, a trajectory of the pointing icon on a force object can trigger a 
force, like a circle gesture. 

The <EMBED ...> command is an existing functionary of HTML. It essentially embeds 
functton calls which are handled by the web browser. If the suffix of the specified file is a known 

30 standard suffix type, the call is executed directly by the web browser. If, however, the suffix ( IFF 
-n thts mstance) is not a standard feature of the web browser, the browser will first .ook for a "plug, 
m" to .mplement this feature and, if a suitable plug-in is not found, it will look for applicat.on 
programs tmplementing this feature. In the preferred embodiment of the present invents, a p.ug-m 
.ncludtng a reference to a Dynamically Lmked Ubrary (DLL) is prov.ded to give functionality to the 

35 .IFF suffix. The DLL can be provided local to the client machine or on another linked resource. 

With contmuing reference to Fig. 7b, the centering command is terminated at line 190 with 

T *f C ° mrnand - Additi ° nal ^ C ° mmandS 192 * Cn be P"> v "ed. -d the bodv 

of the HTML file is terminated by the </BODY> command .94. The end of the HTML file is 

40 HT^f r 3 ' % W ' th "* </H ™ L> C ° mmand - ^ COmmand 1% iS * e """"and of the 
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>ne zuu, a f-OR command initializes a counter i to 0 indict ,h„ * " 
one per each pa. , hrough , he , 00p . and „ * ' « *" J"— ' -i— 1 by 

10 whilei<5 The bod, of, ha,™ • , „ loopshould be compiled five times. /. e. 

ear. meoody of the loop includes a command line 202 which indicnr,* ,h„ , , ^ 

should be pro.rded after lhe vibratlon ha5 occ „ md ? SeCOnd ™ 

,98 wil, cause frecvibrarion^ncnccsscpara^ L t , TT ""*■ " * 

In Fig. 8, the "Parse And Interpret HT1MT r^™ 

co m po„e„,^ ! ,e P , 6 oo f p, 8 ,2 a ,s i ,,„s,, a :dI g ^^T;, , E r : imp \rr mML 

• "» ~ " " *— — en emhc d Z iS^ ZT " " 

- ^-rrsr— 

■n-erpse, due . IFF „, e , and , he ^ „ 8 " mve„„„„ ,„ 

commaand has been uncounted, and ,he srandj web browses ZTZ' ™ ^ ■ 

HTMLconapcneo, i„ a ssep 21, after which me process i s Z^n^"'" ^ "* 

In Fig. 9, the step 210 Plug-In Interprets .IFF File" of Fi* « ;« a. 
25 Process 2,0 begins at 2,6, and in a step 2 7 8 a "framewoJ- ^ T ^ 

name/value pairs are parsed and in a sten ?■>? rh. f u- ■ P °" * c 

30 p«ter, For example, one name might be "BU^ONSTATE" Id^^TT *" 

be "UP" (or "'UNSELECTED'^ Th ^HUNSTATE 311(1 ^ (or parameter) might 

v umtLtL 1 fcD ). The process 210 is completed at 224. 

In Fig. 9a, an image 226 to be displayed on a screen of a viw™ 
display is illustrated. Mo re specifically LL ™ T " ^ 

Navi gator « web browser Z * • § ^ * by ^ P°P ular Ne ^ 

35 a body pon.on 23 Th e n^d ^ 3 ^ ^i" 8 3 ^ P"*» 230 an^ 

P-IH^L^ P ° n '°: 30 ' nClUdeS 3 ° f naVi ^°" b — ?34 and sped, 

roTs In L k : P h U 7 CS W " " ,h0SC f3mi,iar W ' th ^ ^ N^ wcb 

at 238 I H POn ' 0n diSplayS ** URL ° f the ™t.y displayed web pa K e 

at 238. In this instance, the URL is •<http://www.immerse com/demo " n, ■ J 

the body portion 232 of the w.ndow 228 are created! heTf ^ 
40 file by the web browser " af ° remcnt '° n€d Pressing of the HTML 
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The area within (he body portion 232 has been provided with a number of regions and 
buttons to illustrate some of the concepts of the present invention. The force feedback device 
controls the position of a pointer icon 240 which can be caused to interact with the various regions 
and buttons. As an example, when the force feedback device is manipulated bv the user to cause the 
pointer icon 240 to move within a "texture" region 242. force feedback commands can be created for 
the force feedback device to provide a desired "texture" to the force feedback device. For example 
the texture can feel "rough" to the user by causing the force feedback device to place forces on the 
user manipulatable object that emulate a rough or bumpy surface. In a region 244 a "viscosity- 
force feedback can be provided. With this form of force feedback, as the pointer icon is moved 
through field 244. a viscous "drag" force is emulated on the user manipulatable object In a reg.on 
246. menial forces can be felt. Therefore, a pointer icon being moved through an "inertia" reo.on 
would require relatively little or no force to 'move in a straight line, but would require neater forces 
to accelerate in a new direction or to be stopped. The inertial force sensations can be applied to the 
user manipulatable object and felt by the user. In a "keep out" region 248, the pointer image is 
prevented from entering the region. This is accomplished by creating a repulsive force on the user 
manipulatable object using a force feedback command to the force feedback device which prevents or 
inhibits the user from moving the user manipulatable object in a direction of the reg.on 248 when the 
pomtericon 240 contacts the periphery of the region 24S. In contrast, a "snap-in" recion 250 will 
pull a pomter ,con 240 to a center 252 whenever the pointer icon engages the periphery of the snap-in 
reg.on 250 and apply a corresponding attractive force on the user manipulatable object. A "spring- 
region 243 emulates a spring function such that a pointer icon moving into the spnng region 
"compresses" a spring, which exerts a spring force on the user manipulatable object which ooposes 
the movement of the pointer icon. A region 256 is a "Force To Left" region where the pointer icon 
within the reg.on 256 is forced to the left side of the region and the user manipulatable object is - 
forced in a corresponding direction as if influenced by some invisible magnetic force or eravitational 
force. A region 258 illustrates that regions can be of any size or shape and that within a region 
different force effects can be developed. In this example, within region 258 there is a texture core 
260 surrounded by a vibration ring 262. Therefore, as the pointer icon 240 moves into the region 
258, the user first experiences vibration from the ring 262, and then experiences a texture as the 
pointer icon moves within the core 260. 

The exemplary force feedback web page of Fig. 9a is also provided with several force 
feedback buttons. In a first button 264. the placement of the pomter icon 240 over the button and the 
pressing of a button (/.*.. a switch) on the force feedback device to create a "button click", "button 
down", or simply a "button event" input, will then cause a "buzz" command to be sent to the force 
feedback dev.ee. The buzz command would, for example, cause a vibration force on the user 
manipulatable object. Similarly, the selection of the "jolt" button 266 will cause a jolting force (e g 
a short-duration pulse of force) to be provided at the force feedback device, and the pressing of me 
detent" button 268 will cause a "detent" to be created for the force feedback device Bv "detent" it is 
meant that the user manipulatable object will be controlled by the force feedback actuators such that it 
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5 feds as if, mecha,,caJ-tvpe detent exists at the posuion that the user manipulate object was ,n 
when the detent button 268 was activated. J ,n 

In Fig. ,0, a process 270 of the plug-in software of the present invention is illustrated Tne 
Process 270 beg.ns at 272 and, in a step 274. *e p0SItIon and butlon ^ „ 
evce monitored . Nextf jn a s(ep 2?6> a fofce feedback _ 

■0 d tected posn.on and state. Finai.v, a command is sent to the DynamtcaJlv Lmked uZZluo 
place a force feedback command on the interface which can h, „ „ ■ " } 

device. The ptoce, is (hen cooaple ted J^XZ " " *~ 

II should be noted to .he force feedback drive, ( bf „w ser „,„„.,„ or „ „ k 
ability ,„ inKnc , „,„ JAVA code. ,„ embodiniw fc '^^ <~ * 
15 c.™^ „ sing , hc broWs mn ., ime JAVA ™ JAVA 

It should also be noted that the force feedback device itself cm iW , iaw* ■ 

exceed o„ 0, device. JAVA and JAVA inters c hips „ „JZ£Z«1Z SUN 
20 Microcomputers ofMounuun View. California. license Irom SUN 

Furthermore. te forcc fecdback 
™jl provided „ 01her |msulgM ^ > « - o 

^.aphtcrd env.ro™ „ ,„ creasingly ^ ^ ^ » 

such as Acve X available from Microsof.Co^ormion. In .hesc 3-D graphical environments users 

wTrl « w J ^ rCPreSe "" ,it '" S «" — — by „„„ users over the 

Worid Wide Webflmeme, from other cliem computers. Force feedback comm^ds aod p„a™,ety, 
can he provtded m «. iosmaio „ or „,„ „ ^ ^ • <£™ » 

30 client corner system id « edtityaJent ma„„er to ma, described ahove so lha, orce feeZlbe 
expended m s.mulared 3-D space. For example, embedded fomc feedback rod, e c j 

an obsmicon foree ,s genenrieri on the uses-manipulatahje objec,. Or. when the user cartes a vim,,, 
object m a eomrolled u imal glove , , he user migh , , simu|aied ^™ ™* 

35 oser „ ia ,, le ob ,„ s „ h . fc ^ ^ ^ »^ * 

0,0 prescn, «, „ „ ^ ^ ^ ^ 
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including alJ such alterations, permutations, and equivalents as fail within the true spirit and scope of 
the present invention. 



/ 
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CLAIMS 



1 A method for providing force feedback over a network comprising: 
establishing a connection between a server machine and a client machine over a network said 
,0 ,nClUdmg 2 - - * — -rface dev.ee j££ 

feedba 7^ ^ Sa ' d ^ ™ M ^ ^ ^tion and fore- 

feedback mformatton related to said screen display information; 

dissaving on said v.sua. dtsplay of/said client machine a screen image based uoon said 
screen display information; P Id 

15 screen ^ ' ^ ^ ^ *** -pect to sa ,d 

computing a force feedback signal based upon said pointer event; and 

proving a force feedback with said human/computer interface device based upon sa.d force 
feedback s.gnal that is correlated to said screen image on said visual display. - 

0 

2. A method for providing force feedback over a network as recited in clam . w-etn 
sa,d server mach.ne „ a web serve, sa.d client machine is a network access compute, 



„ j J' A mah0d ^ Pr ° Vid,ng f ° rCe feedb * ck ov « a network as recited in claim 2 where.n 

;:r:, s . server md sa,d network access computer — - - — £z 



4 . A method for proving force feedback over a network as recited in claim 2 where.n 
satd potnter event ,« at least one of a pointer icon movement on sa.d visual display with respect to 
30 sa.d screen ,mage and a button click of said human/computer interface dev.ee 



said h ^ / A f0rpr0Viding f ° rCe feedback over * network as recited in c.atm 3 wherein 

satd human/computer mterface device has at leas, two degrees of freedom. 
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6. A method forprovid.ng force feedback over a network as recited in claim 5 wherein 
said human/computer interface device includes a voice coil actuator for providing at least a portion of 
said force feedback. 



7 A method for providing force feedback over a network as recited in claim 5 wherein 
1 0 said human/computer interface has exactly two degrees of freedom. 



8 . A method for providing force feedback over a network as recited in claim 5 wherein 
said human/computer interface is provided with a local microprocessor which communicates with 
said network access computer, said hun/an/computer interface including sensors and actuators 
coupled to said locaJ microprocessor, and wherein said force-feedback signal is a force feedback 
command, said method further comprising: 

parsing said force feedback command on said local microprocessor to control said actuators 
of sa,d human/computer interface in a control loop with said sensors of said human/computer 
interface. 



9. A method for providing force feedback over a network as recited in claim 5 further 
comprising: 

developing on said server machine an HTML file including said screen display information 
and said force- feedback information. 



10. A method for providing force feedback over a network as recited in claim 9 wherein 
said HTML file includes an embedded reference that can be used to create a force feedback object on 
said client machine, and further comprising: 

parsing on said client machine said HTML file and creating on said client machine said force 
feedback object. 



11. A method for providing force feedback over a network as recited in claim 5 further 
comprising: 

developing on said server machine an VRML file includ.ng said screen display information 
and said force-feedback information. 
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monitonng for a pointer even, from .said human/computer ,n, er face; and - 



13. A method for providing force feedback over a network as recite ; . ■ , , 
-rface cap* 0 , prc ,, dmg . ^ me J d ^ZI g ^ 

^ . sa , d firs , clie „, mach ,„ e secmd cfcm intoa[jon ta ^ ^ 

computing a fore, feedback s , s „a, based upon said ^ ^ .^.^ ^ 
20 fee. J'l;? " f0rCC fadbaCk h " m "— -*» **« ^ -PO" - f -e " 

- ====== 

said n 'f AmCth ° df0rprOVldln 8 force ^back over a network as recited in claim 14 wherein 

so it:: event ,s at ieast ° ne ° f a ™ — « «*■ ^ di s P1 a y of jz 
rie™r wi * r ; spect to sa,d screen ,mage - d a butt ° n ° f 

complr "** " etWOrk ^ C ° mPUter ^ ^ — d -work access 



35 said h, ' ^ / A ^ Pr0Vidmg f ° rCe fCCdbaCk ° VCr 2 " etWOrk 35 rec ^d in claim 1 5 wherein 
35 said human/computer interface devices of said first network ar™ 

network acc^™™ . , network access computer and said second 

network access computer each have at least two degrees of freedom 
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5 

! 7. A method for providing force feedback over a network as recited in claim 16 wherei 
said human/computer interface devices each have exactly two degrees of freedom. 



: 8. A method for providing force feedback over a network as recited in claim 17 wherein 
said human/computer interface devices each include a voice coil actuator for providing at least a 
portion of said force feedback. 



15 



20 



19. A method for providing force feedback over a network comprising: 

establishing a connection between a first computer and a second computer over a network, 
where said first computer includes a computer ,nput device providing a first computer input, and 
wherein said second computer includes a visual display and a human/computer interface device 
providing force-feedback in response to a force feedback signal and providing a second computer 
input: 

displaying on said monitor of said second computer a screen image that is associated with 
stored force feedback information: 

receiving from said first computer over said network a first computer input associated with 
said screen image on said second computer: 

determining said force feedback signal based upon said stored force feedback information. 
25 and at least one of said first computer input and said second computer input; and 

providing a force feedback with said human/computer interface device in response to said 
force feedback signal that is correlated to said screen image on said second computer. 



20. A method for providing force feedback over a network as recited in claim 1 9 wherein 
30 said first computer and said second computer communicate over said network using TCP/IP 
protocols. 



21. A method for providing force feedback over a network as recited in claim 1 9 wherein 
establishing a connection includes the exchange of URLs between said first computer and said 
35 second computer. 
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22. A method for providing force feedback over a network as recited in.r . « 

r r co mPU ,„ inpuland sa , d sccond compuKr co i ; 

one of a po.nter movement and a button click. ">ciuarog at least 



. compos^ A me ' h0d ' 0rPr0V ' d '" 8 fedb - ~ ■ —* ~ g TCP/IP pro.ocols 

sending from a diem computer over a nerwork supporting TCP/IP nromrok 
ro,ucs, ,„ a web server conneced ,„ saJ d nElw0 r k ma, is holg , L", C °"" eC " 0 " 

W „ bjK , reference paving ^^^^^1^ tT^ 
force objec, reference and aid associauad parame,e,a ; ' Sa ' d 

developing a force feedback signal wi,h said force object; Md 

providing f 0 r K feedback ,0 a human/compu.er imerface dev.ce coooled ,„ s a,d rf , 
compuier in response ,„ said foroe feedbaok signal. P dlM " 

24 A method for providing force feedbnek over a ne.work s U ppo„,„ g TCP/IP protocols 
as reared ,„ cla.m 23 wher.tn said HTML file oompr.ses , web page o, Jd web Leo 

as roc Jin clnfm^wt PrOV ' dme /° reC "» ' — * TCP/IP p,o,o=„,s 

reaped ,„ cbd.m 24 wheretn a network browser is provided on soid diem oompu.er ,o perform sa.d 
parsmg and developing said force feedback signal. 

as rociJin <£T? "'"T"' ^ * ""^ !U ^'°. -—<. 
ee ac ^ ^ ^ ^ "'^ - *~ - ^opmg s as fore 



rocped ,„ clam, 26 „be ra „ humnn/compuue, interface device is provided with a local 
^processor dna, communis wim sard clicn, compnro, and wherem snid foroe Jul £ 
« a force feedback command sen, from sn,d c„c„, corner ,„ said hunWcompore, m^I 
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28. A method for providing force feedback over a network supporting TCP/IP protocols 
as recited in claim 27 wherein said local microprocessor can interpret JAVA instructions sent from 
said client computer. 



29. A method for providing force feedback over a network supporting TCP/IP protocols 
as recited in claim 27 wherein said human/computer interface device includes actuators and sensors, 
and further comprising: 

parsing on said local microprocessor said force feedback command to control said actuators 
in a feedback loop with said sensors. 1 



30. A networked force feedback system comprising: 
a network: 

a first computer coupled to said network: and 

a second computer coupled to said network, said second computer including a visual display 
and a human/computer interface device capable of providing a second computer input and capable of 
providing force feedback in response to a force feedback signal provideH by .aid second computer, 
said second computer developing an image on said visual display mat is associated with stored 
feedback information, wherein said second computer produces said force feedback signal in response 
to at least one of information derived from said first computer and of said second computer input. 



31. A networked force feedback system as recited in claim 30 wherein said first computer 
is a server computer, said second computer is a network access computer, and wherein said 
information derived from sa.d first computer includes screen display information and force feedback 
information related to said screen display information. 



32. A networked force feedback system as recited in cia.m 3 1 wherein said information 
derived from said server computer is sent from the server computer to the network access computer 
in the form of an HTML file. 



33. A networked force feedback system as recited in claim 3 1 wherein said infonnation 
derived from said server computer is sent from the server computer to the network access computer 
in the form of a VRML file. 
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34. A networked force feedback system as recited in claim 30 wherein both sa.d first 
computer and said second computer are network access mmn , u 

netw 0rk using TCP/IP prQto J s "*» wh '<* -rnmun.cate over sa.d 

15 P»'"Kr icon posnioninp.,! ad a tallon click input. 



37. A networked foncc feedback system as recited in cl„m 30 whdretn said 
o^cooapoter ,„,«rra« device ooupied ,„ s,,d second computer ,„c,„des a ioca, rp^" 
hat co_« wtd, said second compute, a p lurallly of , cnjators for providint a 
-0 and a plural „y of sensors for senstng positions of said „„m,„,comp„,er , n „ rfilce ^ 



25 



30 



38. 



A networked force feedback system as recited in clam 37 wherein said 
uma^computer interface device coupled to saidsecond computer tnc.udes a base for rec Z mpu 
from sad user, sa,d base being movab.e in two hnear degrees of freedom. § ? 

rece , r A netW ° rked f ° rCe feedb3Ck **** as «** in Cairn 38 wherein said base is 
recept.vetoaf.nger of said user for manipu.atmg sa.d base ,n sa.d two iinear degrees of freedorT 

40. A networked force feedback system as recited in claim 38 wherein said base is 

4 1 1 A networked force feedback system as recited ,n claim 37 wherein sa,d force feedback 
stgnal mcludes a force feedback command that can be parsed bv said In™, 
- • uc P arsea oy said locai microprocessor such that 
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42. A networked force feedback system comprising: 
network means; 

first computer means coupled to said network means; and 

second computer means coupled to said network means, said second computer means 
•nc udtng v 1S ua, display and human/computer interface means, said second computer means further 
ndud^ means for displaying an ,mage on sa.d visual display that is associated with stored fo c 
feedback information of said second computer means, said second computer means further mcluZ 
means for analyzing information sent to SaJ d second computer means from said first computed mil 

or r HbT mCanS - S3id SCCOnd C ° mPUter mCanS **** "~» «* ^'op- 

force feedback at said human/computer inter/ace mean, using said stored force feedback infold 

n response to at least one of said infonnation sen, by said first computer means and a secon 
computer .nput providing by said human/computer interface means. 



20 



25 



means , a " ^ " " ^ 42 " ta * ^ «« 

2^ ' s * »™ <°<«P™ ".-ns. saad second compter means is a neswoak access comber 

mean, and wherem said in!ommion dcri „ d ^ ^ fc , ^ P 

mformanon and fosce feedback information ada.ed ,„ said screen d.splav infonmuon 



44. 



A networked force feedback system as recited in claim 43 wherein said information 
denved from sa.d server computer means is sent from the server computer means to the network 
access computer means in the form of an HTML file. 



30 



35 



computer 5 men A "TV ^ ^ ^ " 42 Wherei " ^ «™ 

computer means and said second computer means are network access computer means which 

communicate over said network using TCP/IP protocols. 



denvedfrom iTT^ ^ ^ " * ^ «* inf «" 

from sa.d first computer means includes infonnation that affects said force feedback signaJ. 

derived L JJT*** *"* ^ " ^ *** 46 Wherei " 

on 7 a I" " C ° mPUter mCanS ^ SCCOnd C ° mpUtCr ^ ^ b ° th C -P- - >-t 
one of a pointer icon position input and a button click input. 
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48. A networked force feedback system as recked in claim 42 wherein sa.d 
human/computer means interface device coupled to said second computer means inc.udes a local 
microprocessor means that communicates with said second computer means, a plurality of actuator 
means for prov.ding a force feedback, and a p.urality of sensor means for sensing posuions of sa.d 
human/computer means interface device. 



49 A networked force feedback system as recited in claim 48 wherein said force feedback 
stgnai includes a force feedback command that can be parsed by sa.d locaJ microprocessor means 
such that sa.d microprocessor means can control said actuator means in response to sa.d force 
feedback command in a control loop with said sensor means 

/ 
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